Bloat Control and Generalization Pressure Using the Minimum Description Length Principle for a Pittsburgh Approach Learning Classifier System
نویسندگان
چکیده
Bloat control and generalization pressure are very important issues in the design of Pittsburgh Approach Learning Classifier Systems (LCS), in order to achieve simple and accurate solutions in a reasonable time. In this paper we propose a method to achieve these objectives based on the Minimum Description Length (MDL) principle. This principle is a metric which combines in a smart way the accuracy and the complexity of a theory (rule set , instance set, etc.). An extensive comparison with our previous generalization pressure method across several domains and using two knowledge representations has been done. The test show that the MDL based size control method is a good and robust choice.
منابع مشابه
Technology Extraction for Future Generations from Process Time Series Data Reflecting Expert Operator Skills
This paper proposes a novel method to develop a process response model from continuous time-series data. The main contribution of the research is to establish a method to mine a set of meaningful control rules from Learning Classifier System using the Minimum Description Length criteria. The proposed method has been applied to an actual process of a biochemical plant and has shown the validity ...
متن کاملOn a p-Laplacian system and a generalization of the Landesman-Lazer type condition
This article shows the existence of weak solutions of a resonance problem for nonuniformly p-Laplacian system in a bounded domain in $mathbb{R}^N$. Our arguments are based on the minimum principle and rely on a generalization of the Landesman-Lazer type condition.
متن کاملStatistical and Information-Theoretic Methods for Data Analysis
In this Thesis, we develop theory and methods for computational data analysis. The problems in data analysis are approached from three perspectives: statistical learning theory, the Bayesian framework, and the informationtheoretic minimum description length (MDL) principle. Contributions in statistical learning theory address the possibility of generalization to unseen cases, and regression ana...
متن کاملGenetic Programming Using a Minimum Description Length Principle
This paper introduces a Minimum Description Length (MDL) principle to de ne tness functions in Genetic Programming (GP). In traditional (Koza-style) GP, the size of trees was usually controlled by user-de ned parameters, such as the maximum number of nodes and maximum tree depth. Large tree sizes meant that the time necessary to measure their tnesses often dominated total processing time. To ov...
متن کاملApprentissage statistique et programmation génétique: la croissance du code est-elle inévitable?
N. Bredeche, S. Gelly, M. Schoenauer, O. Teytaud. A Statistical Learning Approach to bloat and universal consistency in genetic programming. Poster of Gecco 2005. S. Gelly, O. Teytaud, N. Bredeche, M. Schoenauer. Apprentissage statistique et programmation genetique : la croissance du code est-elle inevitable ? pp163-178. Proceedings of CAP’2005. Universal Consistency, the convergence to the min...
متن کامل